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1.  Introduction 


The  empirical  Bayes  approach  in  statistical  decision  theory  is  appropriate  when  one 
is  confronted  repeatedly  and  independently  with  the  same  decision  problem.  In  such 
instances,  it  is  reasonable  to  formulate  the  component  problem  in  the  sequence  as  Bayes 
decision  problems  with  respect  to  an  unknown  prior  distribution  on  the  parameter  space, 
and  then  use  the  accumulated  observations  to  improve  the  decision  rule  at  each  stage. 
This  approach  is  due  to  Robbins  (1956,  1964,  1983).  During  the  last  twenty-five  years, 
empirical  Bayes  methods  have  been  studied  extensively.  Many  such  empirical  Bayes  rules 
have  been  shown  to  be  asymptotically  optimal  in  the  sense  that  the  risk  for  the  nth  decision 
problem  converges  to  the  minimum  Bayes  risk  which  would  have  been  obtained  if  the  prior 
distribution  was  known  and  the  Bayes  rule  with  respect  to  this  prior  distribution  was  used. 

Empirical  Bayes  rules  have  been  derived  for  subset  selection  goals  by  Deely  (1965). 
Recently,  Gupta  and  Hsiao  (1983)  and  Gupta  and  Leu  (1983)  have  studied  empirical 
Bayes  rules  for  selecting  good  populations  with  respect  to  a  standard  or  a  control  with 
the  underlying  distributions  being  uniformly  distributed.  Gupta  and  Liang  (1986a,  1987) 
studied  empirical  Bayes  rules  for  selecting  binomial  populations  better  than  a  standard 
or  a  control  and  for  selecting  the  best  among  several  binomial  populations.  In  the  above- 
mentioned  papers,  the  authors  have  assumed  that  the  form  of  the  prior  distribution  is 
completely  unknown.  Hence,  those  approaches  are  referred  to  as  nonparametric  empirical 
Bayes.  Gupta  and  Liang  (1986b,  1988)  have  also  studied  some  other  empirical  Bayes 
selection  rules,  in  which  they  assumed  that  the  form  of  the  prior  distributions  is  known 
but  the  distributions  depend  on  certain  unknown  hyperparameters.  Such  approach  is 
therefore  referred  to  as  parametric  empirical  Bayes. 
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In  this  paper,  we  are  concerned  with  the  problem  of  selecting  good  negative  binomial 
populations  with  respect  to  a  standard  or  a  control  through  the  nonparametric  empirical 
Bayes  approach.  The  framework  of  the  empirical  Bayes  selection  problem  is  formulated 
in  Section  2.  Monotone  empirical  Bayes  selection  rules  are  proposed  in  Section  3.  The 
monotone  empirical  Bayes  selection  rules  are  derived  based  on  certain  monotone  empirical 
Bayes  estimators  of  the  posterior  means  of  the  concerned  parameters  which  are  also  derived 
in  Section  3.  Asymptotic  optimality  properties  of  the  monotone  empirical  Bayes  estimators 
and  the  monotone  empirical  Bayes  selection  rules  are  studied  in  Section  4  and  Section  5, 
respectively. 

2.  Formulation  of  the  Empirical  Bayes  Approach 

Consider  k  +  1  independent  negative  binomial  populations  n r,-,  i  =  0,1,..., k.  For 
each  x,  x  =  0, 1, . . . ,  fc,  let  pt  denote  the  probability  of  success  for  each  trial  in  i r,-  and  let 
Xi  denote  the  number  of  successes  before  attaining  the  rth  failure  in  i r,-.  We  assume  that 
the  trials  for  each  7rt  are  independent,  *  =  0, 1, . . . ,  k.  Then,  conditional  on  pt,  AT,|pt-  has  a 
negative  binomial  distribution  with  probability  function  /,(s|p,)  of  the  form 

h{Avi)  =  (s*-i  1)Pt'(1-p,)r’  z  =  0>1>2---  (2.1) 

Let  7Tq  be  the  control  population.  For  each  i  =  1  population  7rt*  is  said  to  be  good 

if  pi  >  po  and  to  be  bad  if  pt-  <  po,  where  the  control  parameter  po  is  either  known  or 
unknown.  Our  goal  is  to  derive  empirical  Bayes  rules  to  select  all  good  populations  and 
exclude  all  bad  populations. 

When  the  control  parameter  po  is  known,  the  empirical  Bayes  framework  can  be 
formulated  as  follows: 
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(1)  Let  fi  =  {p|p  =  (pi, . . .  ,pk),  Pi  £  (0, 1)  for  *  =  1, k}  be  the  parameter  space.  For 
each  p  G  fl,  define  .A(p)  =  {i\pi  >  po}  and  P(p)  =  {t'|p,-  <  p0}.  That  is,  A(p)(B{p)) 
is  the  set  of  indices  of  good  (bad)  populations. 

(2)  Let  A  —  {a|a  C  {1,2,...,/:}}  be  the  action  space.  When  action  a  is  taken,  it  means 
that  population  7rt-  is  selected  as  a  good  population  if  iea  and  excluded  as  a  bad 
population  if  i  a. 

(3)  For  each  (fixed)  parameter  p  and  action  a,  the  loss  function  L(p,  a)  is  defined  as: 

L(p,a)  =  ^2  (Pi~Po)+  bo  ~  Pi),  (2.2) 

*eA(p)\o  iea\A(p) 

where  the  first  summation  is  the  loss  due  to  not  selecting  some  good  populations  and 

the  second  summation  is  the  loss  due  to  selecting  some  bad  populations. 
k 

(4)  Let  dG{p)  =  II  dGi{pi)  be  the  prior  distribution  on  the  parameter  space  fl,  where 

i=i 

Gi(-)  are  unknown  for  all  i  —  1, ... , k. 

(5)  For  each  i,  t  =  1,  let  (X,y,  3  ““  . . .  ,  n,  be  independent  random  vectors 

associated  with  population  7rt-,  where  is  observable  but  Pty  is  not  observable.  P,y 
has  prior  distribution  G,-.  Conditional  on  P,y  =  pty,  Xij\pij  has  a  negative  binomial 
distribution  with  parameters  r  and  p,y.  Let  the  j th  stage  observations  be  denoted  by 
X j.  That  is,  A'y  -  (A'iy,  A^y,  •  •  • ,  Xjty).  From  the  assumptions,  X\,X2, . . .  Xn,  are 
mutually  independent  and  identically  distributed. 

(6)  Let  ATn+i  =  X  —  (X\,. . .  ,Xk)  denote  the  present  observation.  Conditional  on  p  = 

k 

(pi,...,pjk),  X  has  a  joint  probability  function  f(x\p)  —  n  /*(**|p»)»  where  x  = 

»=i 

(xi, . . . ,  Xk)  and  where  /,(xt|pt)  is  the  negative  binomial  probability  function  given  in 
(2.1)  for  each  *  =  1, . . . ,  k. 
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Finally,  since  we  are  interested  in  Bayes  rules,  we  can  restrict  our  attention  to  the 


nonrandomized  selection  rules. 

(7)  Let  D  =■  {d\d  :  X  —>  A,  being  measurable}  be  the  set  of  nonrandomized  selection 

k 

rules,  where  X  =  n{0>l,2,...}  is  the  sample  space.  For  each  d  6  D,  let  r(G,d) 

i=l 

denote  the  associated  Bayes  risk.  Then  r(G)  =  Jnf^  r(G,  d)  is  the  minimum  Bayes  risk 
and  a  rule,  say  do,  is  called  a  Bayes  selection  rule  if  r(G,da)  —  r(G). 

When  the  control  parameter  po  is  unknown,  the  indices  in  the  associated  notations 
should  begin  at  0  instead  of  at  1.  In  the  sequel,  (0)  will  be  used  to  show  this  additional 
fact. 

We  now  consider  decision  rules  dn{x\X i , . . . ,  Xn)  whose  form  depends  on  the  present 
observation  x  and  the  n  past  data  {X\, . . .  ,Xn )  at  hand.  Let  r(G,dn )  denote  the  overall 
Bayes  risk  associated  with  the  selection  rule  dn(x\  X\, . . .  ,Xn).  That  is, 

r(G,dn)  =  £  E  f  L{j>,dn{x;X1,...iXn))f{x\S)dG{S)  (2.3) 

Jn 

where  the  expectation  E  is  taken  with  respect  to  (X\,. . .  ,Xn).  For  simplicity, 
dn(x ;  Xi,. . . ,  Xn)  will  be  denoted  by  dn(x). 

Definition  2.1.  A  sequence  of  selection  rules  {dn(?)}^Ti  is  said  to  be  asymptotically 
optimal  (a.o.)  relative  to  the  prior  distribution  G  if  r(G,dn)  —*  r(C-r)  asn->  oo. 

For  constructing  a  sequence  of  a.o.  empirical  Bayes  rules,  we  first  need  to  find  the  min¬ 
imum  Bayes  risk  and  the  associated  Bayes  rule  da-  From  (2.2),  the  Bayes  risk  associated 
with  the  selection  rule  d  is: 

r{G,d)  =  ^2  ^2  j  (p0-  Pi)f(x\p)dG{p)  +  C 
xex  ied(x)  n 

{Y,  E  [PO-  £>*  (*»)]/(?)  +  C  if  Po  is  known,  (2.4) 

xex  ied(x) 

E  E  [^0(2:0)  ~  V5i(x») ]/(?)  +  C  if  Po  is  unknown, 

X€X  i£d(X) 
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Jfc 

where  /(x)  =  /t(xt),  m  —  0(1)  if  p0  is  unknown  (known), 

t— m 


fi[xi\p)dGi(p) 


~  p)rdGi(p) 


=  P{*i)hi(xi), 


P(Ti)  =  (*  ,  X) ,  *(*)  =  jf‘p“(l-  p)rrfG,(p). 

H- 

=  “YT — \ —  (  note  that  0  <  tpi(xi)  <  1), 
hiyXi  ) 


and  Ia{')  is  the  indicator  function  of  the  set  A. 

Note  that  in  (2.4),  C  is  a  constant  and  does  not  affect  the  determination  of  the  Bayes 
rule.  Thus,  the  nonrandomized  selection  rule  da  can  be  obtained  as  follows: 


dc{x)  =  {t | A ,-£?($)  <  0}, 


(2.5) 


where 


^  _  f  Po  —  V>i{xi)  if  po  is  known, 

\  ^o(xo)  —  <Pi(xi)  if  Po  is  unknown. 


(2.6) 


Now,  for  each  t  =  (0),  1, . . .  ,k,  based  on  the  past  data  Xn,...,Xin,  and  the  present 
observation  xit  let  <pin(xi)  =  <pin(xi]  Xu,...,  Xin)  be  an  estimator  of  <pi(xt),  and  let 

Ain(x)  =  (  Po  ~  if  Po  is  known, 

\  <Pon(xo)  —  <Pin(xi)  if  Po  is  unknown.  '  '  ' 

We  then  define  an  empirical  Bayes  selection  rule  dn(x;X i, . . . ,  Xn)  =  dn(x )  as  follows: 


dn{x)  =  {t|Atre(x)  <  0}. 


(2.8) 


If  <P*n{x)  — *  ¥?t(a:)  for  all  x  =  0,1,2,...  and  i  =  (0),  1, . . . ,  k,  where  means 

p 

convergence  in  probability,  then  Aln(x)  — >  A,c(z)  for  all  x  G  X .  Therefore,  from  Corol¬ 
lary  2  of  Robbins  (1964),  it  follows  that  r(G,dn )  — >  r(G)  as  n  —*  oo.  So,  the  sequence  of 
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empirical  Bayes  selection  rules  (dn(x)}  defined  in  (2.8)  is  asymptotically  optimal  for  our 
selection  problem.  Hence,  in  the  following,  we  have  only  to  find  sequences  of  estimators 
{<ptn(x)},  *  =  (0),  1, . . . ,  k,  possessing  the  above  mentioned  convergence  property. 

3.  The  Proposed  Empirical  Bayes  Selection  Rules 
Before  we  proceed  to  construct  empirical  Bayes  estimators  {£>jri(x)},  we  first  investi¬ 
gate  some  properties  of  the  Bayes  selecting  rule  da  defined  in  (2.5)  and  (2.6). 

Definition  3.1.  An  estimator  £>(•)  is  called  a  monotone  estimator  if  <p[x)  is  an  increasing 
function  of  x. 

Note  that  for  each  i  =  (0),  1, . . . ,  k,  ipi{x)  =  •  Straight  computations  lead  to 

the  fact  that  <Pi(x)  is  an  increasing  function  of  x  =  0, 1,  2 . . .  Also,  note  that  <Pi{x)  is  the 
posterior  mean  of  p,  given  X{  =  x ,  and  it  is  the  Bayes  estimator  of  p,-  given  X{  —  x  for 
squared  error  loss. 

Let  x,y  G  X  such  that  x,-  <  yt-  for  i  =  (0),  1, . . .  ,k. 

Definition  3.2. 

a)  When  the  control  parameter  po  is  known,  a  selection  rule  d  is  said  to  be  monotone  if 
d(x)  C  d(y). 

b)  When  the  control  parameter  po  is  unknown,  a  selection  rule  d  is  said  to  be  monotone 
if  the  following  two  conditions  are  satisfied: 

(bl)  If  xo  =  y0,  then  d(x)  C  d(y). 

(b2)  If  xo  <  2/o  and  xt-  =  y,-  for  all  t  =  1, . . . ,  k,  then  d(x)  D  d(y). 

By  the  monotone  property  of  the  Bayes  estimators  <pi(x),  i  =  (0),  1, . . . ,  /c,  one  can 
see  that  the  Bayes  selection  rule  do  is  a  monotone  selection  rule  for  both  cases,  where  the 
control  parameter  po  is  either  known  or  unknown. 
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Under  the  squared  error  loss,  the  problem  of  estimating  the  probabiltiy  of  success  in 
a  negative  binomial  distribution  is  a  monotone  estimation  problem.  By  Theorem  8.7  of 
Berger  (1985),  for  a  monotone  estimation  problem,  the  class  of  monotone  estimators  form 
an  essentially  complete  class.  Also,  for  the  present  selection  problem,  under  the  linear  loss 
given  in  (2.2),  the  problem  is  a  monotone  decision  problem.  Again,  from  Berger  (1985), 
the  class  of  monotone  selection  rules  form  an  essentially  complete  class.  Now,  one  can  see 
that  if  the  estimators  <pin{x),  i  =  (0),  1, . . . ,  k,  are  monotone,  then  the  empirical  Bayes 
selection  rule  given  in  (2.7)  and  (2.8)  is  also  monotone.  From  these  considerations,  it  is 
reasonable  to  require  that  the  concerned  estimators  {<ptn(x)}  possess  the  above-mentioned 
monotone  property. 

Lin  (1972)  studied  some  empirical  Bayes  estimation  problems  for  a  class  of  discrete 
exponential  family  distributions  which  include  the  negative  binomial  distributions  as  a 
special  case.  Though,  the  estimation  procedure  he  proposed  is  asymptotically  optimal,  the 
proposed  estimator  does  not  possess  the  monotone  property.  Recently,  Liang  (1988)  stud¬ 
ied  empirical  Bayes  test  for  the  class  of  discrete  exponential  family  distributions.  Liang 
(1988)  proposed  a  monotone  empirical  Bayes  estimator  for  the  corresponding  Bayes  esti¬ 
mator.  Based  on  that  monotone  empirical  Bayes  estimator,  the  empirical  Bayes  test  which 
he  proposed  is  monotone.  Here,  we  use  this  idea  of  Liang  (1988)  with  some  modification 
since  one  can  obtain  more  information  about  the  interesting  parameter  p,  the  probability 
of  success,  for  the  underlying  negative  binomial  distribution. 
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The  Proposed  Monotone  Empirical  Bayes  Selection  Rules 


Let  Fi(x)  denote  the  marginal  distribution  function  of  the  random  variable  X{.  That 
is, 

X  X 

#(*)  =  5^/*'(y)  =  5^0(v)Mv)»  *  =  0,1,2,...,  (3.1) 

y=o  y=o 

where  /?(y)  =  an<^  =  fo  Py(l  —  p)rdG*(p),  which  is  decreasing  in  y.  The 

form  of  (3.1)  will  be  used  to  construct  our  empirical  Bayes  estimators. 

For  each  *  =  (0),  1, . . . ,  k,  based  on  the  past  data  Xu, . . . ,  Xtn,  let 

(3*2) 

To 

j= i 

and 

M*)  =  |f  (3.3) 

for  x  =  0, 1,2  . . .. 

In  view  of  the  decreasing  property  of  the  function  h,(y),  it  is  desirable  that  the 
corresponding  estimator  possess  the  same  property.  To  meet  this  requirement,  we  let 
(*) } i=o  be  the  antitonic  regression  of  {/it-n(x)}£L0  with  weight  {/?(x)}£E0.  Then,  let 

X 

=  E  KM,  (3.4) 

y= o 

where 

finiv)  =  0{y)h*in{y),y  =  0,1,2....  (3.5) 

Note  that  /i,*n(x)  is  nonincreasing  in  x,  and  h^n(x)  =  0  if  x  >  max(X,i, . .  .,Xin)  for 
each  n  and  each  i.  By  the  decreasing  property  of  the  function  ht  (x)  in  x,  from  Barlow,  et 
al  (1972), 

F{n{x)  >  Fin[x)  (3-6) 
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and 


SUP  \Fin(x)  -  <  sup|Fin(x)  -  Fi(x)\  (3.7) 

z>0  x>0 

where  Fin(x)  is  the  empirical  distribution  function  based  on  X,i, . . .  ,Xtn.  That  is, 
1  A  13:1 

Fin(x)  =  -  2J  I\ojX\{Xij)  =  /^(y)^tn(y),  where  [x]  denotes  the  largest  integer  not 

J=i  y=o 

greater  than  x. 


Now,  for  each  x  =  0, 1, 2, . . . ,  max(X,i, . . . ,  Xtn)  -  1,  define 


<Pin{x)  = 


Kni^_  +  X) 

KnW 


(3.8) 


Note  that  by  the  nonincreasing  property  of  the  antitonic  estimators  »*.(*).  0  < 
<Pin{x)  <  1  for  x  =  0, 1, . . . ,  max(X,i, . . . ,  X,n)  —  1.  However,  <Pin{x )  does  not  possess 
the  monotone  property.  A  smoothed  version  of  <pin(x),  which  possesses  the  monotone 
property  is  given  as  follows:  Let 

{max  <pin  (y)  if  y  <  max(Xtl , . . . ,  Xin)  -  1, 

(3.9) 

^u(max(Xll, . . . ,  Xin)  -  1)  if  y  >  max(X,i, . . . ,  Xin)  -  1. 

From  (3.9),  it  is  easy  to  see  that  ^n(x)  possesses  the  monotone  property.  Now,  for 
each  x  £  X ,  define 


f  Po  -  ’Pinixi)  if  po  is  known, 

l  Pin(xo)  -  (Pin(xi)  if  Po  is  unknown. 


(3.10) 


We  then  popose  a  montone  empirical  Bayes  selection  rule,  say  d*n ,  as  follows: 


<*»(*)  =  MAinte)  <  °}- 


(3.11) 
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Asymptotic  Optimality  of  the  Selection  Rules  {d* } 


As  mentioned  above,  to  prove  the  asymptotic  optimality  of  the  sequence  of  empirical 

p 

Bayes  selection  rules  {d*  },  it  suffices  to  prove  that  <p*in{x)  — *  <Pi(x)  for  all  x  =  0, 1,2, ... , 
and  i  =  (0),  1, . . . ,  k. 

For  each  x  =  0, 1, 2, . . . ,  let  t  be  a  positive  number  small  enough  so  that  <  l 

and  <pi(x)  —  t  >  0.  We  need  to  prove  that 


“  Pi{x)\  >  0  -►  0  as  n  -*  oo. 

Now, 

~  iPi(z)|  >  t} 

=  Pirtni*)  ~  <Pi(x)  <  “0  +  Pirtni*)  ~  V>i{x)  >  0* 

By  the  definition  of  ip*in(x),  v^n(x)  >  <Pin(x).  Thus, 


(3.12) 


P{<Pin{x)  ~  iP.fa)  <  ~t} 

<  P{<pin(x)  -  (pi(x )  <  -t} 

=  P{<Pin{x)  -  <Pi(x )  <  -t,  and  max(Xti, . . . ,  X,n)  <  x}  (3.13) 

+  -P{^tnb)  -  <p(x)  <  -t,  and  max(AT,i, . . .  ,X,n)  >  x}. 

We  have 


P{<Pin{x )  -  <Pi{x)  <  -t  and  max(ATti, . . .  ,Xt-n)  <  x}  <  [i'i(x)]' 


which  tends  to  0  as  n  — ►  oo,  since  0  <  F{(x)  <  1  for  all  x. 

Also,  note  that  h*in(x)  >  0  as  x  <  max(Xil, . . . ,  Xin).  Let  p(x,  t)  = 
and  q(x,t)  =  Note  that  p(x,t)  >  0  since  t  is  a  positive  number  such  that 
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<Pi{x)  —  t  >  0.  From  (3.1),  (3.4),  (3.5),  (3.7)  and  (3.8),  we  have: 


P{<Pin{x)  ~  <Pi{x)  <  -t  and  max(Xll, . . . ,  Xtn)  >  x} 

<  pihinix  +  1)  -  h-*in(x)[(pi(x)  -  t]  <  0} 

=  p{fin(x  +  !)  -  fin(x)p{x,t)  <  0} 

=  pipL{*  +  1)  -  p;n(x)[l  +  p(x,t )]  +  F*n(x  -  1  )p(x,t)  <  0} 
=  p{[pL(x  +  1)  -  Fi(x  +  1)]  -  (F;n(x)  -  Fi(x)][l  +  p(x,  0] 

+  [Pin ix  !)  -  ^(a:  —  l)]p(a:,  f)  <  -q{x,t)} 


<  P{F?„(x  +  1)  -  F,(x  +  1)  < 

?(x,  t) 


+  P{F?n(x)  -  Fi(x)  > 


3(1  +p{x,t)} 


} 


<3P{,u 

<  3P{sup|Ftri(y)  -  Ft(y)|  >  --^1^—-} 
y>o  3[1  +  p(x,  £)] 

which  tends  to  zero  as  n  tends  to  infinity,  by  the  Glivenko-Cantelli  Theorem. 
Similarly, 


(3.14) 


P{Pin (•*')  “  <PiiX)  >  t} 

—  Pihinix)  ~  <Pi{x)  >  t  and  max(X,-i, . . .  >  Xin)  <  X }  (3.15) 

+  PiPinix)  -  <Pi{x)  >  t  and  max(Xtl, . . . ,  Xtn)  >  x} 

where 

p{<Pin{x)  ~  V5,(x)  (  an d  max  j , .  * . ,  ^ ^  x )  ^  0  as  ti  ^  oo , 
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and  by  the  fact  that  <Pi(x)  >  (pi(y)  for  all  y  <  x,  and  the  definition  of  <Pin{x), 


P{<p*in(x)  -  <pi(x)  >  t  and  max(Xti, . . . ,  Xin)  >  x} 

=  P{<Pin(y)  —  <Pi(x)  >  t  for  some  y  <  x  and  max(X,i, . . .  ,  Xtn)  >  x} 

<  P{<Pin{y )  -  <Pi{y)  >  t  for  some  y  <  x,//n(y)  >  0}  (3.16) 

<  P{fin{y  +  !)  -  finiv)  +  t]  >  0  for  some  y  <  x} 

=  P{\Fin(y  +  1)  -  ^n(y)]  -  [FiM  -  Fin{y  -  1)]^(^)1hy?f(y)  +  t]  >  0  for  some  y  <  x} 


_Df  WM.  ■  IA(2/  +  i)-/i(y)^gfiMy)  +  i|l, 

<  3P{sup  Ftn(y  -  Fi  y  >  mm - - - g(v+1),  ,  r - : - }, 

which  tends  to  zero  as  n  tends  to  infinity. 

Based  on  the  above  discussions,  we  have  shown  that  <Pin{x)  — »  <Pi(x)  for  each  x  = 
0,1,...  and  each  *  =  (0),  1, . . . ,  k.  Therefore,  the  sequence  of  empirical  Bayes  selection 
rules  {d*  }  is  asymptotically  optimal. 


4.  Asymptotic  Optimality  of  the  Monotone  Estimators 
In  this  section,  we  study  the  asymptotic  optimality  property  of  the  estimators  P{n{x). 
It  is  known  that  under  the  squared  error  loss,  <Pi(x)  is  the  Bayes  estimator  of  p,  given 
X{  =  x.  The  associated  Bayes  risk  is 


Ri{Gi)=E[{Pi-<pi(Xi))2].  (4.1) 

Let  xpi(-)  be  any  estimator  of  p,-  with  the  associated  Bayes  risk  Ri(Gi,ipi).  Then 

Ri(Gi,ipi)  -  Ri{Gi)  =  -<Pi{Xi))2}-  (4-2) 

Let  {^^(x;  Xu, . . . ,  X{n)  =  ^in(x)}  be  a  sequence  of  empirical  Bayes  estimators  based 
on  (x,  .Xt'i, .  • . ,  -ATtri). 
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Definition  4.1. 

a)  A  sequence  of  empirical  Bayes  estimators  is  said  to  be  asymptotically  opti¬ 

mal  relative  to  the  prior  distribution  G  if  i2t(G,-,  ipin)  — ►  i?,(Gt)  as  n  — >  oo. 

b)  A  sequence  of  empirical  Bayes  estimators  {V't'n}^=i  is  said  to  be  asymptotically  opti¬ 
mal  at  least  of  order  an  relative  to  the  prior  distribution  Gt-  if  P,(Gt-,  ipin)  —  Ri(Gi)  < 
0(an)  as  n  — >  oo,  where  {<*„}  is  a  sequence  of  positive  values  such  that  lim  <*n  =  0. 

n — ►oo 

p 

From  Section  3,  <P{n[x )  — *■  <pi(x)  for  all  x  =  0,1,2,....  Thus,  is  asymp¬ 

totically  optimal.  However,  the  usefulness  of  empirical  Bayes  estimators  in  practical  ap¬ 
plications  clearly  depends  on  the  convergence  rates  with  which  the  risks  for  the  successive 
estimation  problems  approach  the  optimal  Bayes  risk.  Hence  in  the  following,  we  study 
the  convergence  rates  of  the  sequence  of  empirical  Bayes  estimators  {£>?n}. 

For  0  <  e  <  1,  let 

Ai(e)  =  {x\fi(x)  <  e},  B,(e)  =  {z| /<(*)  >  e}.  (4.3) 


Assumption  A: 

Al.  There  exist  f,e(0,  l]  and  a  positive  constant  c,-  such  that  P(A,(e))  <  c<e*4  for  all 

e  £  (0, 1). 

A2.  There  exists  a  positive  integer  iVt-  such  that  fi(x)  is  decreasing  in  x  for  x  >  N{. 

Remark  4.1.:  An  example  such  that  Assumption  A  holds  true  is  given  in  Lin  (1972). 

We  have  the  following  theorem. 

Theorem  4.1.  Let  be  the  sequence  of  empirical  Bayes  estimators  defined 

in  (3.9).  Then,  under  Assumption  A, 

Ri{GiMn )  -  Ri{Gi)  <  0(n~t{^2+t^). 
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The  proof  of  Theorem  4.1  can  be  obtained  based  on  the  following  arguments. 
For  the  empirical  Bayes  estimator  <Pin,  straight  computation  leads  to 


0  <  Ri{Gi,ip*in)  -  Ri{Gi) 

=  £[(*>£, (*i)  -  OT(*))J| 

oo 

=  Y  -  <Pi{X))2\Xi  =  x]fi{x)  (4.4) 

x—Q 

=  Y  -  <Pi{x))2\Xi  =  x]fi(x) 

xtAi{6n) 

+  Y  E\&in{X)  ~  <Pi(x))2\Xi  =  x]fi(x), 

xeB{(sn) 

where  Sn  —  n~ai  and  a,-  =  j+F- 

Lemma  4.1.  Under  Assumption  A, 


Y  El(Pin(x)  -  V>iix))2\Xi  =  x]fi{x)  <  0(n  t</(2+t<)). 

x€Ai(6n) 


Proof:  Note  that  0  <  <pfn(x ),  <pi(x)  <  1.  Thus, 

Y  El(V<n(X)  ~  <Pt(X))2  lXi  =  x]fi{x) 

z€Ai(6n) 

<  E  /<(*) 

x£A{(6n) 

=  J’UiWO) 


<  C{n  a,t'  (by  the  definition  of  A,(<5n)  and  Assumption  Al) 

=  0{n~u^2+u>)). 

Thus,  it  suffices  to  study  the  asymptotic  behavior  of  E[((p^n(x)  —  <pi(x))2\Xi  = 

x<=B{(6n) 


x)fi(x).  Now,  for  each  x  €  Bi(6n), 


£(bin(z)  -  Vi{x)Y\Xi  =  x] 

=  EMn{x)-<Pi(x))*Iin[z) \Xi=x\ 

+  ^[(lPin(*)  -  ^f(x))2(l  -  /,„(x))|X,-  =  x],  (4.5) 
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where 


1  if  fin  (x)  >  0, 
0  if  /»n  (*)  =  0, 


(4.6) 


and  fin (x)  is  as  defined  in  (3.2). 


Lemma  4.2.  For  x  £  -Bi(<5n) 


E[(<Pinix)  ~  P*(z))2(l  ~  Iin(x))\Xi  =  x]  <  0(n  *</(2+*<)). 


Proof: 


-  <Pi  (*))*(  1  -  An(x))|ATt-  =  x] 

<  P{/tn(a)  =  0} 

=  P{fin{x)  -  fi{x)  <  ~fi{x)} 

<  exp{— 2 n/2(x)}  (by  Theorem  1  of  Hoeffding  (1963)) 

<  exp{— 2n62}  (since  x  €  Bi(6n)) 

=  exp{-n**'^2+t^} 

<  0(»-*‘/<2+ti>). 


Remark  4.2.:  Note  that  in  Lemma  4.2,  the  upper  bound  is  independent  of  x  for  all  x  £ 


Next,  a  straight  computation  leads  to: 


£[(Pin(X)  “  <Pi{x))2Iin(x)\Xi  =  x] 


0 


2sP{<p,+n(x)  -  (pi (x)  <  -s,fin{x)  >  0 }ds 


(4.7) 
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Lemma  4.3.  a)  For  x  G  B{(8n ),  and  s  €  (0,  v?»(z)), 


P{<Pin{x)  -  <Pi{x)  <  ~s  and  fin(x)  >  0}  <  3 d{  exp{ - 2 n[—  SihfL  — ]2 } 

3(l  +  p(x,sj) 

for  some  positive  constant  d,-,  where  p(x,s )  =  ~  >  0  and  q{xis)  = 

sf3{x  +  l)fj(x)  „ 

W)  >  u- 

b)  For  x  €  Bi(Sn), 


r<Pi(x) 

/  2 sP{^>t*n(x)  -  <pi(x)  <  -s  and  /tri(x)  >  0 }ds  <  0(n~t{^2+ti')) 

Jo 


and  the  upper  bound  is  independent  of  x  for  all  x  G  Bi(6n). 


Proof:  a)  First,  it  is  trivial  that  p(x,s )  >  0  and  g(x,s)  >  0.  Next,  that  ftn(x)  >  0 
and  from  the  definitions  of  ft*n(x)  and  /i?n(x),  it  follows  that  /,*„(x)  >  0  and  h^n(x)  >  0. 
Also,  <pfn(x)  >  <Pin(x),  by  the  definition  of  <Pin{x).  Then,  following  (3.14),  we  obtain:  For 
x  G  Bi(6n )  and  5  G  (0,v9,(x)), 


PiVinfa)  -  <Pi(x)  <  -*  and  fin{x)  >  0} 

<  P{<Pin{x)  ~  <Pi{x)  <  -s  and  /tn(x)  >  0} 

<  P{hinix  +  1)  -  /l-n(x)[v?i(x)  -  5]  <  0} 

<  3P{sup|Fin(y)  -  F<(y)  |  >  ~  } 

y>0  3[l  +  p(x,s)) 

<  3*  exp{-2n|-I-^',)  )»}, 

3[1  + p(x,s)]J 

for  some  positive  constant  d,-,  where  the  last  inequality  follows  from  Lemma  2.1  of  Schuster 
(1968). 
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b)  By  using  the  fact  that  0  <  <  1  and  <  r  for  all  x  >  0,  we  have 

1  +  p(x ,  s)  <  1  +  r.  Then,  from  the  result  of  part  a)  of  this  Lemma,  we  obtain 


L 

<  r  2 n  sfi{x 

<  J '  6 di  s  exp{ — — [ - - 


IsPiVinix)  ~  <Pi(x)  <  ~S,fin(x)  >  0 }ds 
a)  2  nsfj{x)^L 


+  r 


-n* 


<  I3.6*fi±«i  x 


1 


(32{x  + 1)  n/?(x) 


<  13.5d,(l  +  r)2^jj  (since  x  €  .B,(£n))  and  therefore, /,(x)  >  6n) 


=  Oin-W+V). 


Note  this  upper  bound  is  independent  of  x  G  Z?t(5n). 

By  Assumption  A2,  /t  (x)  is  decreasing  in  x  for  all  x  >  JV,-.  In  the  following,  we  only 
consider  the  case  where  n  is  large  enough  such  that  6n  =  n_5+* 7  <  /,(y)  for  all  y  <  N{. 
Thus  as  x  €  B{(6n),  then  fi(y)  >  for  all  y  <  x  (this  holds  true  for  either  x  <  IV,-  or 
x  >  AT,).  Therefore,  analogous  to  (3.16),  by  the  definition  of  <P{n(z),  we  obtain: 

For  s  €  (0, 1  —  <p,(x)), 


P&inix)  -  <Pi{x)  >  S,fin(x)  >  0} 

=  P{<Pin{y)  -  <Pi(x)  >  S  for  some  y  <  x,  /tn(x)  >  0} 

<  3P{sup|Fl*n(y)  -  P,(y)|  >  -minif(y)} 

y>0  y<x 

<  3 di  exp{— 2n[—  minif(y)]2}  (by  Lemma  2.1  of  Schuster  (1968)),  (4.8) 

y<x  V  9 

where 

fi{y  + 1)  -  /.(y)  ^te^b.-(y)  + «] 

H(y)  = 
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(4.9) 


If* MS 

3!‘  +  W 

<  zlIiM 

-  3[1  +  r] 

<  rrr-fe ,  (  since  /t  (y)  >  6n) 


<  0. 


Lemma  4.4.  For  n  sufficiently  large,  and  x  £  Bi(Sn), 


-<Pi(x) 


2sP{<Pin{x )  -  <Pi(x)  >  >  0 }ds  <  0(n  t</(2+t<)). 


Proof:  From  (4.8)  and  (4.9),  for  n  sufficiently  large,  as  x  £  Bi(6n), 

rl-<Pi(x) 

/  2$P{v?fn(x)  -  <?*(*)  >  s,fin(x )  >  0}ds 

Jo 

1  -»?;(*) 


<-S 

Jo 


2n6%s 
di  eXp{~9(f+  r)2}d6 


=  0(n_t*^2+t^). 

From  Lemmas  4.2,  4.3,  4.4  and  (4.7),  we  have:  For  x  £  P,(<5n), 


£[(*>;„(*)  -  «=iW)2|AT,  =  x)  <  0(»-^/<2+1')). 


This  upper  bound  is  independent  of  x  £  Therefore,  we  conclude  that 

-  <Pi{x))2\Xi  =  x]fi{x)  <  0(n_ti/(2+t*)). 

ses,(5„) 

Then,  Lemma  4.1,  (4.4)  and  (4.10)  together  complete  the  proof  of  Theorem  4.1. 


(4.10) 
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5.  Asymptotic  Optimality  of  the  Empirical  Bayes  Selection  Rules 


In  this  section,  we  study  the  asymptotic  optimality  of  the  sequence  of  empirical  Bayes 
selection  rules  {d*n}. 

Let  be  a  sequence  of  empirical  Bayes  selection  rules  relative  to  the  prior 

distribution  G.  Let  r(G,dn )  denote  the  expected  Bayes  risk  of  the  selection  rule  dn.  Since 
the  Bayes  rule  dc  achieves  the  minimum  Bayes  risk  r(G),  r(G,dn )  —  r(G)  >  0  for  all 
n  =  1,2, —  Thus,  the  nonnegative  difference  r(G,dn)  —  r(G)  is  used  as  a  measure  of  the 
optimality  of  the  sequence  of  empirical  Bayes  selection  rules  {dn}. 

Definition  5.1.  The  sequence  of  empirical  Bayes  selection  rules  {dn}^Li  is  said  to  be 
asymptotically  optimal  at  least  of  order  an  relative  to  the  prior  distribution  G  is  r(G,  dn)  — 
r(G)  <  0(an)  as  n  — »  oo,  where  {£*„}  is  a  sequence  of  positive  numbers  such  that  lim 

n— ►  oo 

&n  =  0. 

In  the  following,  we  evaluate  the  asymptotic  behavior  of  the  sequence  of  empirical 
Bayes  rules  {d*  }  proposed  in  Section  3,  according  to  whether  the  control  parameter  p0  is 
known  or  unknown. 


Convergence  Rates  of  for  pn  Known  Case 


For  each  t  =  1, . . . ,  k,  let  S{  =  {x| <pi(x)  <  po}  and  T,  =  {x| <Pi[x)  >  p0}.  Define 


Mi=  I 


min  Ti  if  T,-  ^  (f>, 
oo  if  Ti  —  <j>. 


(5.1) 


and 


(  max  Si  if  S{  ^  <j>, 
\  —1  if  S{  =  <j>. 


(5.2) 
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By  the  increasing  property  of  <Pi(x)  with  respect  to  the  variable  x  =  0,1,..., m,  < 
also  m,-  <  Mi  if  Tt  ^  (f>.  Furthermore, 

(  x<mi  iff  <pi(x)  <  p0 ;  and  .  . 

1  y  >  M{  iff  ipi(y)  >  pQ.  '  '  ’ 

Note  that  when  Ti  =  cf>,  it  meas  that  in  terms  of  its  quality,  the  population  7 r,-  is 
bad.  Also,  for  Si  =  <f>,  it  means  that  in  terms  of  its  quality  population  7 r,-  is  as  good  as 
the  control.  We  exclude  these  extreme  cases,  in  the  following,  and  study  the  asymptotic 
behavior  of  the  sequence  of  empirical  Bayes  selection  rules  {d* }  under  Assumption  B. 

Assumption  B:  Tt-  ^  <f>  and  5,-  ±  <p  for  all  t  =  1, . . . ,  k. 

Now,  for  the  empirical  Bayes  selection  rule  d*,  a  direct  computation  leads  to  the 
following: 


0<r(G,d'J-r(G) 

k 

=  £>,(0,0, 


i— 1 


(5.4) 


where 


TTij  OO 

A(G,d*)  =  ^2{po  -  <Pi{x)]P{<p*n(x)  >  p0}fi(x)  +  \Pi{x)  -  Po}P{<P*in{x)  <  p0}fi{x). 

*=0  2 =Mi 

(5.5) 

By  the  nondecreasing  property  of  the  estimator  <p*in ,  we  have 


f  ^  Po}  <  PiPini171')  ^  Po}  for  all  X  <  mi,  and 

I  PiPiniv)  <  Po}  <  P{<Pin{Mi)  <  po}  for  all  y  >  Mi. 


Thus,  from  (5.5)  and  (5.6), 


A(G,d*)  <  P{<p*in(mi)  >  p0}bn  +  P{<p*in(M )  <  p0}6t-2,  (5.7) 
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mi  oo 

where  6tl  =  £  [Po~<Pi{x)]fi{x),  and  bi2  =  £  [<Pi(x)-po]/i(*).  Note  that  0  <  6tl,  6i2  < 

i=0  i=M, 

1. 

Now, 


P{<p*n(Mi)  <  po} 

=  <  Po,  max(X,i, . . .  ,Xtn)  <  MJ 

+  <  Po,  max(Xfi, . . . ,  Xin)  >  Mi} 

<  [Ft(M,)]n  +  P{(p*n{Mi)  <  po,  max(X,i, . . .  ,Xin)  >  M,}. 
Analogous  to  Lemma  4.3.  a),  we  can  obtain 

P{Pin(Mi)  <  Po  and  max  (XtX, . . .  ,Xin)  >  Mt} 

<  P{KniMi  +  1)  <  h*n(Mi)p0  and  max(Xtl, . . .  ,Xtn)  >  Mt} 

<  3 di  exp{-?nA2(M,-,p„)/[l  +  ^OpoP). 

where  A(M,-,p0)  =  +  1)  -  >  0. 

From  (5.8)  and  (5.9),  we  have 


(5.8) 


(5.9) 


<  Po}  <  0(exp(— rtln)) 
where  t,- j  min  ( — — /uir+’ry^ —  In  A .  s ) . 


Also, 


>  Po} 

=  P{<P*n{mi)  >  p0,max(Xtl, . . . , Xin)  <  mt} 

+  p{Pin(mi)  >  Po,  max(Xti, . . . ,  Xin)  >  mi} 

<  [F,(mt)]n  +  P{<p*in(mi)  >  po,  max(X,i . ..Xin)  >  mt}. 


(5.10) 


(5.11) 
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Analogous  to  (3.16),  we  obtain 


P{v>in{mi)  >  Po,  max(X,i . . .  Xin)  >  mj 
=  P{(pin{y)  >  Po  for  some  y  <  m,-,max(X,i  . . .  Xin)  >  m,} 

<  3p(sup  |f;v.  -  F,{z)\ >  min  — -i } 

*>o  »S«  3|1  +  %Up„] 

r 

9  77.  I  A  f  7/  Tl/^  I 

<  3d,-  exp  < 


/ 

1 

2) 

2  n 

|A(y,p0)| 

l 

“*  mm 

9  y<m, 

< 

i  +  iiy±llVn 

L  +  P(y)  PoJ 

) 

(5.12) 


where  A(p,p0)  =  /,( y  +  1)  -  /i(y)^ffipo-  Note  that  A(y,p0)  <  0  for  all  y  <  m,-. 

Thus, 

P{<Pin{mi)  >  Po}  <  0(exp{-ri2n}),  (5.13) 


where  r„  =  min  ( |  mm  ( )  •  <»  Klkl 

Let  r,-  =  min(r,i,r,i),  and  r  =  min(ri, . . .  ,  r&).  Note  that  r  >  0,  since  r,  >  0  for  each 
*  =  1  From  the  above  results  the  following  theorem  follows: 


Theorem  5.1.  Under  Assumption  B,  we  have: 

a)  Di{G,  d*)  <  0(exp(— r,-n))  for  each  t  =  1 ...  fc,  and 

b)  r(G>rfn)  “  r(G)  <  0(exp(— rn)). 

Convergence  Rates  of  fd*)  for  pn  Unknown  Case 

When  the  parameter  po  is  unknown,  the  convergence  rates  of  the  sequence  of  empirical 
Bayes  selection  rules  {d*  }^<L1  is  evaluated  under  Assumption  A  which  is  given  in  Section  4. 
Without  loss  of  generality,  in  this  section,  we  assume  that  Co  =  c\  =  ...  =  c*  =  c  >  0 
and  to  =  *i  =  ...  =  £*  =  <  G  (0, 1],  where  the  parameters  c,-,  i,-,  t  =  0, 1 . . .  k  are  given  in 
Assumption  Al. 
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For  each  t  =  1, . . . ,  k,  let 

Si  =  {(*o,*f)|lPi(*t)  <  <Po{x0)},Ti  =  {(*o,*t)b»(*0  >  V3o(x0)} 
E{n  =  {(x0,a;t-)||pt-(£t-)  -  <Po(xo)|  <  £n},  and 
Ein  =  {(xo,x»)||<p,-(xf)  -  <po{x0)\  >  £„}  where  en  >  0. 

Thus, 


0<r(C,<)-r(G) 


K 


=  EA'(g,0, 


t=l 


(5.14) 


where 

Di(Gi<t*n)  =  22  Qi{xo,Xi)+  22  Ri(x0,Xi) 

(xo.xi)eTi  (x0  ,xi)eSi 

=  22  Qi(zo,*i)+  Y1  Qi{x0,xi)+  22  Qi(xo,xt) 

T‘nE‘«  T{nEfnnAo(6n)nA{(Sn)  T{nE?nnA0(Sn)nBi(6n) 

+  22  Qi{xO,Xi)+  22  Qi(x0>  Xi) 

TinE?nnBQ(6n)nA;(8n)  TinE?nnB0(6n)nBi(6n) 

+  22  Ri(*o,xi)  +  22  Ri(x0,xi)+  J2  Ri(x0,xi) 

5*n£;*'»  S{nE?nnA0(6n)nA<(8n)  s 'inE?nnA0(8n)nBi(8„) 

+  22  Ri(x0,Xi)+  22  R\  {x0 ,  X{) ,  (5.15) 

5,nBfnnB0(fi„)nyi,(5„)  5,n^nnBo(5„)nB.(5n) 


where 


f  Q,(x0,xt)  =  b,(x,)  -  <Po{xo)}P{<P*in{xi)  <  (pQn (xo)} fi (xt')/o (x0) , 

1  P,(x0,Xt)  =  [V30(x0)  -  >  PSn(^o)}/.(xt)/o(x0), 

and  the  notation  £  means  that  the  summation  is  computed  over  the  set  A. 
A 

Careful  examination  leads  to  the  following  results: 


2  v  Qi{xOi  xi)  ^  0{£n)i  2  y  Pt(xo,Xt)  <  0(s'n), 

T,nB,rl  SiHEin 
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Y  Qi{xo,Xi)  <0(^), 
r;nEfnnA0(5n)nyli({„) 

Y  Ri{x0iXi)<O{Sl%  (5.17) 

sinE?nnA0(6„)nAi(5„) 

Y  Qi{x0,Xi)  <  0(6ln), 

T{nE9nnAo(Sn)nB{(Sn) 

Y  Ri(x0,xi)  <  0(61), 

SinE?nnA0(6n)nBi(Sn) 

Y  Qi{xo,Xi)  <  0(8„),  and 

TinE?nnBo(6n)nAi(6n) 

Y  Ri[x0,xi)  <  0(6*). 

SinEinnBo(Sn)r\A{(Sn) 

Now,  for  ( x0,Xi )  G  T{  n  Ecin  D  B0{6n)  n  Bi(6n),  >  <5„,  /0(x0)  >  and  ern  < 

<Pi{xi)  -  <po{xo)  <  1.  Thus, 


PiPinixi)  <  Pte(Xo)} 

=  -  <P«(*<)]  -  (POn(Xo)  -  ^0(^0)]  <  tpo{x0)  ~  <Pi{xi)} 

<  P{<Pin{xi)  ~  <Pi(Xi)  <  ~  y}  +  P{£>Sn(xo)  -  <P0  (Xo)  >  y}. 


(5.18) 


Now, 

-<Pi(xi)  <  -y} 


-  <pf(*0  <  ~~^,fin(xi)  =  0}  +  P{^in(x,)  -  <Pi(xi)  <  ,fin{xi )  >  0}, 


where 


-  *>.(*<)  <  -f  =  0} 

<  -P{/in(l>)  =  0} 


and 


<  exp{— 2n<5^}(  since  G  B;(6n);  and  see  Lemma  4.2), 


P^'Pin  (*c»)  -  <Pi(xi)  <  -y, /,•»(*<)  >  0} 


<  3dt  exp{~— 7f  -ne^} 


18(1  +  r)2/?2(xt) 


<  0(exp{- 


nelSl 


18(1  +r)2 


}).  (The  proof  is  analogous  to  that  of  Lemma  4. 3. a). 
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Therefore, 


Pi<Pin{xi)  ~  <Pi{xi)  <  -y}  <  Q(exp{---^^2}).  (5.19) 

Next,  under  Assumption  A2,  along  the  line  of  (4.8)  and  the  argument  given  there,  for 
n  sufficiently  large,  we  have 

P{<Pon{x o)  -  <Po{x0)  >  y}  <  Q(exp{~— ^^2».  (5.20) 

Note  that  the  convergence  rates  obtained  at  (5.19)  and  (5.20)  are  independent  of 
(xo,Xi)  6  Ti  fl  Efn  D  Bo(6n)  n  Bi(8n).  Therefore,  from  (5.16)  and  (5.18), 

E  Q.(*0,*,)<O(exp{-  “  ’ ‘  })■  (5.21) 

Similarly,  we  can  also  conclude  that 

Y,  Ri(xo,Xi)  <  O (exp {  —  rr~~~r 2  }) ■  (5.22) 

SinE?nnB0(6n)nBi(6n)  1  t  J 

By  letting  6n  =  2+2t  and  en  =  6^  we  have  the  following  theorem. 

Theorem  5.2.  Under  Assumption  A,  we  have 

a)  D*(G,d*n)  <  0(«5‘)  for  *  =  1  ,...,fc,  and 

b)  r(G,  d*)  —  r(G)  <  0(6*). 

Proof:  The  proof  follows  directly  from  (5.14),  (5.15),  (5.17),  (5.21)  and  (5.22). 
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